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Abstract 

We address the question of whether the primal-dual approach for the design and analysis of 
online algorithms can be applied to nonmonotone problems. We provide a positive answer by pre- 
senting a primal-dual analysis to the online algorithm of Awerbuch et al. 1AAPW01I for routing 
virtual circuits with unknown durations. 
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1 Introduction 

The analysis of most online algorithms is based on a potential function (see, for example, MAAP93I 



AKP+971 lAAF+971 lAAPWOll in the context of online routing). Buchbinder and Naor HBN091 pre- 



sented a primal-dual approach for analyzing online algorithms. This approach replaces the need to find 
the appropriate potential function by the task of finding an appropriate linear programming formulation. 

The primal-dual approach presented by Buchbinder and Naor has a monotone nature. Monotonicity 
means that: (1) Variables and constraints arrive in an online fashion. Once a variable or constraint 
appears, it is never deleted. (2) Values of variables, if updated, are only increased. We address the 
question of whether the primal-dual approach can be extended to analyze nonmonotone algorithmo 

An elegant example of nonmonotone behavior occurs in the problem of online routing of virtual 
circuits with unknown durations. In the problem of routing virtual circuits, we are given a graph with 
r*^ ■ edge capacities. Each request r^ consists of a source-destination pair (sj,ij). A request r« is served 

■>sj- I by allocating to it a path from Sj to r^. The goal is to serve the requests while respecting the edge 

capacities as much as possible. In the online setting, requests arrive one-by-one. Upon arrival of a 
request rj, the online algorithm must serve r^. In the special case of unknown durations, at each time 
step, the adversary may introduce a new request or it may terminate an exiting request. When a request 
terminates, it frees the path that was allocated to it, thus reducing the congestion along the edges in 
the path. The online algorithm has no knowledge of the future; namely, no information about future 
requests and no information about when existing requests will end. Nonmonotonicity is expressed in 
this online problem in two ways: (1) Requests terminate thus deleting the demand to serve them. (2) The 
congestion of edges varies in a nonmonotone fashion; an addition of a path increases congestion, and a 
deletion of a path decreases congestion. 

Awerbuch et al. HAAPWOll presented an online algorithm for online routing of virtual circuits when 
the requests have unknown durations. In fact, their algorithm resorts to rerouting to obtain a logarithmic 
competitive ratio for the load. Rerouting means that the path allocated to a request is not fixed and the 
algorithm may change this path from time to time. Hence, allowing rerouting increases the nonmonotone 
characteristics of the problem. 
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'The only instance we are aware of in which the primal-dual approach is applied to nonmonotone variables appears 
in IBFGN11I . In this instance, the change in the dual profit, in each round, is at least a constant times the change in the 
primal profit. In general, this property does not hold in a nonmonotone setting. 



We present an analysis of the online algorithm of Awerbuch et al. BAAPW01H for online routing of 
virtual circuits with unknown durations. Our analysis uses the primal-dual approach, and hence we show 
that the primal-dual approach can be applied in nonmonotone settings. 

2 Problem Definition 

2.1 Online Routing of Virtual Circuits with Unknown Durations 

Let G = (V, E) denote a directed or undirected graph. Each edge einE has a capacity c e > 1. A routing 
request r k is a 4-tuple r k = (s^, d k , a k , b k ), where (i) s k , d k G V are the source and the destination of 
the kth routing request, respectively, (ii) a k G N is both the arrival time and the start time of the request, 
and (iii) b k G N is the departure time or end time of the request. Let T k denote the set of paths in G 
from s k to dk- A request r k is served if it is allocated a path in IV 

Let [N] denote the set {0, . . . , N}. The input consists of a sequence of events a = {<?t}te[N]- We 
assume that time is discrete, and event at occurs at time t. There are two types of events: (i) An arrival 
of a request. When a request r k arrives, we are given the source s k and the destination d k . Note that the 
arrival time a k simply equals the current time t. (ii) A departure of a request. When a request r k departs 
there is no need to serve it anymore (namely, the departure time b k simply equals the current time t). 

The set of active requests at time t is denoted by Alivet and is defined by 

Alive t = {r k \ a k $ t < b k } . 

An allocation is a sequence A = {p k } k of paths such that p k is a path from the source s k to the 
destination d k of request r k . Let paths t (e, A) denote the number of requests that are routed along edge 
e by allocation A at time t, formally: 

paths t (e, A) = \{p k : e G p k and r k G Alive t}\ ■ 

The load of an edge e at t is defined by 

loadt(e, A) 

The load of an allocation A at time t is defined by 

loadt(A) = max loadAe, A) . 

e£E 

The load of an allocation A is defined by 

load (A) = maxloadt(A) . 

An algorithm computes an allocation of paths to the requests, and therefore we abuse notation and 
identify the algorithm with the allocation that is computed by it. Namely, ALG(cr) denotes the allocation 
computed by algorithm ALG for an input sequence a. 

In the online setting, the events arrive one-by-one, and no information is known about an event 
before its arrival. Moreover, (1) the length N of the sequence of events is unknown; the input simply 
stops at some point, (2) the departure time b k is unknown (and may even be determined later by the 
adversary), and (3) the online algorithm must allocate a path to the request as soon as the request arrives. 

The competitive ratio of an online algorithm ALG with respect to N G N, and a sequence a = 
Wltepv] is defined by 

A load(ALG(a)) 
p(ALG(a)) £ 



± paths t (e, A) 



load(OPT(a)) ' 



where OPT (a) is an allocation with minimum load. The competitive ratio of an online algorithm ALG is 
defined by 

p(ALG) = sup m&x p(ALG(o~)) . 

iVeN a 

Note that since every request has a unit demand, we may assume that c e > 1 for every edge e G E. 

2.2 Rerouting 

In the classical setting, a request r^ is served by a fixed single path pk throughout the duration of the 
request. The term rerouting means that we allow the allocation to change the path p\. that serves r\~. 
Thus, there are two extreme cases: (i) no rerouting at all is permitted (classical setting), and (ii) total 
flexibility in which, a new allocation can be computed in each time step. 

Following the paper by Awerbuch et al. HAAPWOll . we allow the online algorithm to reroute each 
request at most 0(log |V|) times. In the analysis of the competitive ratio, we compare the load of 
the online algorithm with the load of an optimal (splittable) allocation with total rerouting flexibility. 
Namely, the optimal solution recomputes a minimum load allocation at each time step, and, in addition 
may serve a request by a convex combination of paths. 

3 The Online Algorithm ALG 

In this section we present the online algorithm ALG that is listed in Algorithm [T] Thus algorithm is 
equivalent to the algorithm presented in HAAPWOll . 

The algorithm maintains the following variables. 

1. For every edge e a variable x e . The value of x e is exponential in the load of edge e. 

2. For every request r^ a variable Zk- The value of Zk is the complement of the "weight" of the path 
Pk allocated to r^ at the time the path was allocated. 

3. For every routing request r^, and for eveiy path p € Tk a variable fk{p)- The value of fk(p) 
indicates whether p is allocated to r\~. That is, the value of fk(p) equals 1 if path p is allocated for 
request r&, and otherwise. 

The algorithm ALG consists of the following 5 procedures: (1) MAIN, (2) ROUTE, (3) DEPART, 
(4) UnRoute, and (5) MakeFeasible. 

The Main procedure begins with initialization. For every e € E, x e is initialized to ^-, where 
m = \E\. For every k € [N], Zk is initialized to zero. For every k £ [N], and for every path p, fk(p) is 
initialized to zero. Since the number of Zk and fk(p) variables is unbounded, their initialization is done 
in a "lazy" fashion; that is, upon arrival of the kth request the corresponding variables are set to zero. 

The main procedure Main proceeds as follows. For every time step t G [N] , if the event at is an 
arrival of a request, then the ROUTE procedure is invoked. Otherwise, if the event a t is a departure of a 
request, then the Depart procedure is invoked. 

The ROUTE procedure serves request r\. by allocating a "lightest" path pk in the set I^ (recall that 
Tfc denotes the set of paths from the source Sk to the destination dk)- The allocation is done by two 
actions. First, the allocation of pk to request r& is indicated by setting fk{Pk) ^~ 1- Second, the loads 
of the edges along p^ are updated by increasing the variables x e for e € pu- The variable z^ equals the 
"complement" weight of the allocated path p^. Note that this complement is with respect to half the 
weight of the path before its update. 

The Depart procedure "frees" the path that is allocated for p\., by calling the UnRoute procedure. 
The UnRoute procedure frees p^ by nullifying fk(Pk) and Zk, and by decreasing the edge variables 
x e for the edges along p&. The freeing of pk, decreases the load along the edges in pk- As a result of 



this decrease, it may happen that a path allocated to an alive request might be very heavy compared to a 
lightest path. In such a case, the request should be rerouted. This is why the MakeFeasible procedure 
is invoked after the UnRoute procedure. 

Rerouting is done by the MakeFeasible procedure. This rerouting is done by freeing a path and 
then routing the request again. Requests with improved alternative paths are rerouted. 

The listing of the online algorithm ALG appears in Algorithm [T] 

Algorithm 1 ALG: Online routing algorithm. The input consists of (1) a graph G = (V, E) where each 
e € E has capacity c e , and (2) a sequence of events a = {o~t}te[N]- 

MAIN((7t) 
1: Vfc G [N] :z k ^0. 
2: Ve G E : x e <- 4-, where m = \E\. 

Am ' I I 

3: Vr k £[N]Vp:f k {p)^0. 

4: Upon arrival of event a t do 

5: if a t is an arrival of request r k then Call ROUTE(ffc). 

6: else (at is an departure of request r k ) Call DEPART(r-fe). 

RQUTE(r fc ) 

1: Find the "lightest" path: p k <- argmin{J] egp/ fj | p' G r fc }. 

2: z k <- 1 - § • E eSPfc fr- 

3: Route r fc along p k : f k (p k ) <- 1. 

4: for all e £ p k do 

5: a; e <— a; e ■ A e where A e = ( 1 + -^- ) . {Update edge "load"} 

DEPART(r fc ) 
1: Call UNRouTE(r fc ). 
2: Call MAKEFEASIBLE(a;, z). 

UNROUTE(r fc ) 

1: 

2 
3 



Free variables: z k ,f k (p k ) 
for all e e p k do 

x e /X e where A e = ( 1 + -^— ) ■ {Update edge "load"} 



MAKEFEASIBLE(a;, z) 



Vrj G Alivet if 3p G Tj : z 3 + E eep ff < 1 then 

CallUNROUTECr-j). 
CallRouTE(rj). 



4 Primal-Dual Analysis of ALG 

In this section we prove that the load on every edge is always 0(log \V\), and that each request is 
rerouted at most 0(log \V\) times. We refer to an input sequence a as feasible if there is an allocation 
A, such that for all requests that are alive at time t, it holds that loadt(A) < 1. The following theorem 
holds under the assumption that the input sequence a is feasible. Note that the removal of this assumption 
increases the competitive ratio only by a constant factor by standard doubling techniques HAAPWOU . 

Theorem 1 ( BAAPWOIIO . If the input sequence a is feasible and assuming that c e > 1, then ALG is: 

1. An 0(log \V\) -competitive online algorithm. 

2. Every request is rerouted at most 0(log \V\) times. 

We point out that the allocation computed by ALG is nonsplittable in the sense that at every given 
time each request is served by a single path. The optimal allocation, on the other hand, is both totally 
flexible and spilttable. Namely, the optimal allocation may reroute all the requests in each time step, 
and, in addition, may serve a request by a convex combination of paths. 



P-LP(t) : min y~] Zk + ^ x e 

r k £Alivet eG-E 


s.t. 
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Figure 1: (I) The primal LP, P-LP(i). (II) The dual LP, D-LP(i). 

The rest of the proof is as follows. We begin by formulating a packing and covering programs for our 
problem in Section |4~T1 We then prove Lemma[T]in Section l4~2l We conclude the analysis with the proof 
of Theorem [T]in Section 1431 



4.1 Formulation as an Online Packing Problem 

For the sake of analysis, we define for every prefix of events {o"j}* =1 a primal linear program P-LP(t) 
and its dual linear program D-LP(t). The primal LP is a covering LP, and the dual LP is a packing LP. 
The LP's appear in Figure [Q 

The variables of the LPs correspond to the variables maintained by ALG, as follows. The covering 
program P-LP(i) has a variable x e for every edge e G E, and a variable z k for every r k G Alive t . The 
packing program D-LP(t) has a variable f k {p) for every request r k G Alivet, and for every path p G T k . 
The variable fk(p) equals to the fraction of r^'s "demand" that is routed along path p G T k - 

The dual LP has three types of constraints: capacity constraints, demand constrains, and sign con- 
straints. In the fractional setting the load of an edge is defined by 



loadt(e) 



1 



E E ago 

r k £Alive t {p\p£~T k ,e£p} 



The capacity constraint in the dual LP requires that the load of each edge is at most one. The demand 
constraints require that each request r k that is alive at time t is allocated a convex combination of paths. 

If the dual LP is feasible, then the objective function of the dual LP simply equals the number of 
requests that are alive at time step t, i.e., |AZ/vet|. 

The primal LP has two types of constraints: covering constraints and sign constraints. The covering 
constraints requires that for every request r k that is alive and for every path p G T k , the sum of z k and 
the "weight" of p is at least 1. Note that the sign constraints apply only to the edge variables x e whereas 
the request variables z k are free. 

Note that the assumption that a is feasible is equivalent to requiring that the dual program D-LP(t) 
is feasible for every t. 



4.2 Bounding the Primal Variables 

In this section we prove that the primal variables x e are bounded by a constant, as formalized in the 
following Lemma. 

Lemma 1. If at is an original event, then 

VeeE : x® < 3 . 

The proof of Lemma[T]is based on a few lemmas that we prove first. 

Notation. Let x e ,z k denote the value of the primal variables x e , z^ before event at is processed by 
ALG. Let P t denote the objective function's value of p-lp(£), formally: 



Let A t P ± P t +i - P t . 

Note that P t refers to the value of P-LP(t) at the beginning of time step t. The definition of Alivet 
implies that the constraints and variables of P-LP(t) are not influenced by the event at (this happens only 
for P-LP(t + 1)). Hence the variables in the definition of P t are indexed by time step t. 

Dummy events. The procedure ROUTE is invoked in two places: (i) in Line [5] of Main as a result 
of an arrival of a request, or (ii) in Line|3]of MakeFeasible. To simplify the discussion, we create 
"dummy" events each time the MakeFeasible procedure reroutes a request. Dummy events come 
in pairs: first a dummy departure event for request r^ is introduced, and then a dummy arrival event 
for a "continuation" request ru is introduced. The combination of original events and dummy events 
describes the execution of ALG. The augmentation of the original input sequence of events by dummy 
events does not modify the optimal value of the dual LP at time steps t that correspond to original events. 
Hence, we analyze the competitive ratio p(ALG(<r)) by analyzing the competitive ratio with respect to 
the augmented sequence at time steps t that correspond to original events. 

The following lemma follows immediately from the description of the algorithm ALG and the defi- 
nition of dummy events. 

Lemma 2 (Primal Feasibility). If at is an original event, then the variables {x e } e eE U {z« }e£AUve t 
constitute a feasible solution for P-LP(i). 

Proof. When an original event ov occurs, the MakeFeasible procedure generates dummy events at 
the end of the time step to guarantee that the primal variables are a feasible solution of the primal LP. 
Hence, if at is an original event, then the primal variables at the beginning of time step t are a feasible 
solution for P-LP(i). □ 

Lemma 3. If at is an arrival of request, then AtP < 1. 

Proof. Assume that at is an event in which request r^ arrives. In Step|2]of the ROUTE algorithm z^ is 

set to 1 — 7j • SeGp fe c • m Step [5] of the ROUTE algorithm, for every e Gpt, x e is increased by ^-. 
All the other edge variables x e remain unchanged. Hence, 

e£p k eSpfe 

1 ^ T W 

<1, 



as required. □ 

We refer to the number of requests that are routed along edge e by allocation ALG at time t by 

paths t (e). 



Lemma 4. For every t and e G E, 



(t) _ \Paths t (e) 



x e 

Am 



Proof. The proof is by induction on t. At time t = 0, we have x e = -%- and paths t (e) = 0. The proof 
of the induction basis for t + 1 depends on whether at time step t an arrival or a departure occurs. If the 
event does not affect edge e, then the induction step clearly holds. Assume that the event affects edge e. 
If a request r^ arrives at time t, then paths t+1 (e) = paths t (e) + 1 and xi = xi ■ A e . If a request r& 
departs at time t, then paths t+1 (e) = paths t (e) — 1 and x e = x e /A e . □ 

Let Deadt = {r^ | bk < t}. In general, it is not true that A aj P + A^P < 0, however on average it 
is true, as stated in the following lemma. 

Lemma 5. For every t, 

J2 (A a ,P + A 6 .P) <0. (2) 

rj (LDeadt 

Proof. First we prove the following proposition. 

Proposition 1. Consider a set of I = {Ij = [ay,/3j]}? =1 such that no two intervals share a common 
endpoint. Let cut(t) denote the number of intervals that contain t. Then, there is a permutation ir : 

[l,q] — > [1,q] such that 

Vj'G[l,g] : cut(aj) = cut(P n ^) . (3) 

Proof. The proof is by induction on the number of intervals. The induction basis, for q = 1 holds 
trivially because cut(a±) = cut((3i) = 1. The proof of the induction step is based on the existence of 
a pair a. t < j3j such that the open interval (ctj, j3j) does not contain any endpoint of the intervals in I. 
For such a pair, we immediately have cut (on) = cut(/3j) so we define tv(i) = j and apply the induction 
hypothesis. 

We first show that such a pair ai < (3j exists. We say that an interval I m is minimal if I m n If. ^ 
implies that I m C 1^. If there exists a minimal interval I m , then set a>i = a m and j3j = f3 m . In such 
a case since 7r(m) = m, we can erase I m and proceed by applying the induction hypothesis to the 
remaining intervals. Note that equality of cut sizes is preserved when the interval I m is deleted. 

Consider the set of pairs of intersecting intervals without containment defined as follows 

A = {(i,j) | oij <ai </3j <Pi} . 

If there is no minimal interval, the set A is not empty. Any pair (i,j) G A that minimizes the difference 
((3j — ai ) has the property that the interval (ai , j3j ) lacks endpoints of intei-vals in /. 

We can define n(i) = j. We proceed by applying the induction hypothesis on (I \ {Ij,Ii}) U Ik, 
where 4 = /; U Ij. Note that equality of cut sizes is preserved when Ii and Ij are merged into one 
interval. □ 

The difference A a P consists of two parts: 



( a o) 



4c e 



The difference A b P consists of two parts as well: 






ee Pj 



It follows that 

4c, 



Tj aDeadt Tj dDeadt e 



1 /Lfo) _ _(^0)+ 1 ) 



rj eDeadt e 



where it is any permutation over the set of requests. In fact, we shall use for each edge e, a different 
permutation -k = ir(e) that is a permutation over the requests r^ such that e G p^. 

Assume first that Alivet = 0- We later lift this assumption. 

Fix an edge e. For each request rj such that e G Pj, map the duration (oy, bj] of request rj to the 
interval [aj + 1, bj]. The resulting set of intervals satisfies cut(t) = paths t {e) for every time step t. Let 
-k denote the permutation guaranteed by Prop. \T\ Then, it suffices to prove that 

X K)_ X ^) +1 ) =0 . (4) 

T j j , T m a ( M (bn (i) +l)\ .P^hs paths b +1 

Indeed, by Lemma |4J Am ■ [x e — x e I = A e — A e . In addition, the property 



of permutation -k states that cut(a,j + 1) = cut{b^u\). It follows that paths a . + i = paths b But, 
paths a = paths a+1 — 1 and paths b +1 = paths b — 1, and Equation|4]follows. 

To complete the proof, consider the requests in Alive t . Because aj, b^u) < t, requests in Alivet do 

not increase the difference xk — x e ■ Thus if — x e 7r<: ' ) < 0, and the lemma follows. □ 

We are now ready to prove Lemma [Q Recall that Lemma Q] states that the primal variables x e are 
bounded by a constant. The proof of Lemma [T] is by contradiction. In fact, we reach a contradiction to 
weak duality, that is, we show that the value of the primal solution is strictly smaller than the value of a 
feasible dual solution. 

Proof of Lemma\l\ The proof is by contradiction. Assume x e > 3 and at is an original event. Define 

£2 — min{£ | x® > 3 and at is an original event}. 

Let t± be the time step for which x e x < 1 and x* > 1 for every t' G \t\ + 1, £2]- 
Define: 

Alive Ge (ti,t2) = {rj \ t\ < aj < t2 < bj,e £ pj}. 

Let 5 e denote the difference between the number of arrivals and the number of departures in the time 
interval [£1,^2) among the requests that were routed along e. Clearly 5 e < \Alive &e (ti, £2)!- 
Lemma H] implies that 

The assumption that x e 2 > 3 and x e < 1 imply 

1 \ 6 ° 
1+ 4Z» 



Since 1 + x < e x , it follows that 5 e > 4 • c e . Hence, 

\AUve ee (t 1 ,t 2 )\ >4-c e . (5) 

By EquationQ} for each j*j € Aft've ee (ti, fe)> we have: 

A^P < 1 - ±. (6) 



Hence, 



P ^ = i--+E A ^ 



4m 

\+ £ (A a ,P + A 6j P) + £ A 0j .P 

Tj(iDeadt2 rj£AHvet 2 



< 






< - 4 + \Ahve t2 \ 

< \Alive t2 1 . (7) 

The justification for these lines is as follows. The first line follows from the initialization of the primal 
variables. The second line follows since every event in time step t G [0, £2 — 1] is either an arrival of a 
request in Deadt 2 UAlivet 2 or a departure of a request in Deadt 2 . The third inequality is due to Lemma|5] 
The fourth equation is due to Equation [6] The last inequality follows from Equation [5] 

By Lemma|2j the primal variables at time £2 are a feasible solution of p-lp(£2)- The optimal value 
of D-LP(t2) equals \Alivet 2 1. Hence, Equation |7] contradicts weak duality, and the lemma follows. □ 

4.3 Proof of Theorem ffl 

We now turn to the proof of the main result. The proof is as follows. 

Proof of Theorem^ We begin by proving the bound on the competitive ratio. Lemma |4] states that 

I / 1 \ paths t (e) 

\/t Ve G E : x e = — • ( 1 + — 
4m \ 4c e 

Hence, by Lemma [Q for each original event a t , 

1 / 1 \ paths t^ 

Ve G E : — ■ ( 1 + — ) < 3 . 

Am V 4c e / 

Since 2 X < 1 + x for all x G [0, 1], it follows that for each original event at 

Ve G E : paths t (e) < c e • 41og(12m) , 

and the first part of the theorem follows. 

We now prove the bound on the number of reroutes. Rerouting an alive request rj occurs if there exists a 

path p G Tj such that Yle&p 7~ ^ 1 — -Zj ■ By Line|2]of the ROUTE algorithm, this condition is equivalent 

SO 
to: J]eGp ~ < 2 Seep ^c — • Namely, each time a request is rerouted, the weight of the path is at 

least halved. Note that the halving is with respect to the weight of the path at the time it was allocated. 



Let us consider request r,. Let p* = argmin er .-Q^ eg ^-}. By the choice of a "lightest" path and 
by Lemma [Q the weight of path pj is upper bounded by 

e<=Pj eSp* e£p* 

By LemmaHl x e > l/(4m), hence the weight of path pj is lower bounded by 

^-— ' c P ~~ 4m ■^-^ c P ~~ Am *—* c P 

e£p e eSp eGp* 

It follows that the number of reroutes each request undergoes is bounded by log 2 (12m), and the 
second part of the theorem follows. □ 

Remark 1. Note that the first routing request will not be rerouted at all, the second routing request will 
be rerouted at most twice, and so on. In general, a routing request that arrives at time t will be rerouted 
at most \Alivet \ times. 

5 Discussion 

We present a primal-dual analysis of an online algorithm in a nonmonotone setting. Specifically, we 
analyze the online algorithm by Awerbuch et al. HAAPWOll for online routing of virtual circuits with 
unknown durations. We think that the main advantage of this analysis is that it provides an alternative 
explanation to the stability condition for rerouting that appears in HAAPWOll . According to the primal- 
dual analysis, rerouting is used simply to preserve the feasibility of the solution of the covering LP. 

Our analysis provides a small improvement compared to HAAPWOll in the following sense. The 
optimal solution in our analysis is both totally flexible (i.e., may reroute eveiy request in every time 
step) and splittable (i.e., may serve a request using a convex combination of paths). The optimal solution 
in the analysis of Awerbuch et al. HAAPWOll is only totally flexible and must allocate a path to each 
request. 

The primal-dual approach of Buchbinder and Naor HBN091 is based on bounding the change in the 
value of the primal solution by the change in the dual solution (this is often denoted by AP < AD). The 
main technical challenge we encountered was that this bound simply does not hold in our case. Instead, 
we use an averaging argument to prove an analogous result (see Lemma[5]). 
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